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TflE DESIGN AND IMPLEMENTATION OF AN ON-LINE INFORMATION 
SYSTEM TO FACIL^ITATE THE MANAGEMENT OF 
INDIVIDUALIZED INSTRUCTION 



It is genei^a^ly agreed that if instruction is adapted to the 
specific lea^^ing needs of the individual it will fie more effective. In 
order to detet;mine specific instructional needs, it is neqessaty to diag- 
nose student cjiaracteristics prior to instruction and then u6e the diag- 
^ nostic. test results as the basis for prescribing alternative insttuction. 
Then, in order to assure individual ptogress, student perfotmance is moni- 
tored and repeatedly assessed. In addition to monitoring student progress, 
it is necessary' to collect data to assess the effectiveness of the in- 
structional assignments and tests to, evaluate the toolB of the learning 
model. All of this requires a great dea?. of recordkeeping, and efficient 
information retrieval procedures, lor these reaspns, computer assistance 
is indispensable for an effective individualized instruction System. 

* The computer can be used to assist in the management of instruc- 
tion in many ways. It can be used to administer tests, to process stu- 
^nt data, to display instructional options, or even to conduct instruc- 
tion. However, the focus of tht6 paper will be the design arid implementa- 
tion of an on-line information system to facilitate the management of in- 
dividualized instruction. | 

r 



Oakieaf School Inf ormiation Retrieval System 



The overall goal of this system is to store and retrieve instruc- 
tional and testing data for the putpose of monitoring student progress, 
making instructional management decisions, making curriculum evaluations, 
and conducting re8earch\ More specifically, the implementation of this 

/ . 3 



system was atteit^pt^d in order to: (1> provide specific real-time data, 
(2) provide periodic status reports to replace time consuming hand-pre- ♦ 
Sared .recordl^eping, O) classify data in a systematic, peaningful manner, 
and (4) accumulate essential statistics internally for later analysis. 

■ Th/^ besjt way to understand this system is to trace the infotma- 
tion^ow' as given Anpigure 1. The information flow is divided into 
ten st6ps with in/tiaflization ds the first step. Prioi^ to the beginning 
of each academic/yeai either the programmer or the colter operator will 

/ • ' ' 

remove all of ^e previous year's ^ta from the system and create a new 
student roste/ with updated backgrdpd information (i.e., latest stand- 
ardized achi/vement test scores, clps's and grade changes, and the names 

of new studfents) . . ' 

After a i\cw roster is entered, the system is ready for data gath- 
ering. /As described in Step 2 (Figure 1), the aide ftft each class enters 
studen/ data through Cathode \ay -Tube (CRT) termin&ls at the end of each 
day. /Thifl- data is obtained from prescription sheets prepared by teachers, 
By /sing the program ^THER, new data is entered. This data makes up 

temporary or t-files. When the aide completes the entering of all 
/ata for a class, (s)he innnediately lists tlie t-files and checks the 
^accuracy of* the data as shown in Step 3. If errors are discovered, the 
aide uses the CHANGE program to make any necessary corrections <5n the 
t-files. When the" t-files have been checked and corrected, the aid-e , 
^ noti^^ws^ither the programmers or computer operators so that they can 
incorporate new t-files Into the permanent data base as descri^ in 
Steps 4 and 5. Before updating the data base, the computer operator . 
copies the t-file onto DECTAPE as a backyp measure. When the copying 
process is complete, the program UPDATE will be executed in order to 
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incorpor/ate the t-files into the permanent data base /which consists of 
Inverted and Direct files. (The Structure of tjie data .base is presented 

in jthe next section.) If any errors are discpver/d after the incorpora- 

) 

tion of the t-file into the permanent data base/ the program DLDBRC may , 
be used to deliete the incorrect data. Substitnitions for this deleted 
data- must be entered subsequently througl^^TllER, . 

After executing the UPDATE program, new datji will exist in^.the 
permanent data base alnd, therefore, any retrieval programs executed sub- 
sequently will reflecfi these additions. As shown in Step 7, the computer 
operator will generatte two regular reports for each class. Each report 
includes a weekly summary of students who have completed a skill or unit, 
a list of students who "did not complete any skills, and students vbo 
failed curriculum embedded tests or post tests more thdn once, these re- 
ports are useful for teachers in monitoring thejpr^^ess d^d^tatus of 
students. Examples of these two reports are shown in Flguit^ 2. 
* As shovmjLa ^tep 8, other standard reports can be requested at 

ly^'time by teachers, supervisory personnel, curriculum developers, test 
constructors,, and researchers. The advantage of these standard reports 
is that they are very easy to use. Each standard report has a specific 
format of output and the type ;6f variables printed are fixed. However, 
since the type of variables printed are fixed, some of the Output printed 
may not be heeded by all users. Some sample outputs for standard re- 
ports are given in Figures '3 through 7 . 

The QUERY program listed in Step 9 was designed for interactive 
information retrieval. In using this program, the user must specify the 
types of variables to be retrieved and thfi sequence of variables to be 
printed* The advantages of this program are that users can specify the 
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REPORT 1 ' f I' . , ' 

WEEKLY PROGRESS REPORT DAYS 110-1 lA 
GRADE 5-1 

STUDEm'S WHO COMPLETE^ A' UNIT DURING TH'IS TIME RIERIQD 



',K 



STUDENT 

\ ' 

d6e/John< 
smith/harry 

JOflESfBOB I 
JACOBS, Bill 



UNIT 

"PMULT 
/£SCM 
. -G^P 
' EGEO 



DAY, OF DAY OF 
pre/sem GOMPL 



101 
96 
93 
83 



llA 
110 
113 
114 



C 



STUDENTS/PROGRESS IN UNITS WITH STATUS CURRENT 



WONDERS/ALICE 
SMART, SUSAN 

MOUSE /MIKE 

JS,JODY 



UNIT PRE 

M/36 99 
EFRAC 106 



SKILL 



DAY OF 



ACjriY MASTERED ACTIV 



* OF UNITS 
COMPLETEDdO DAY) 




FAPP 
FDIV 



93 
93 



F /PCET 

6 /PRRE 

7 /PPRE 

3 /PCET 

4 /PCET 

2 /PCET 

3 /PCET 



112 
111 
111 
113 
114 
110 
114 



0 
3 



(116) 
(116) 



/ 



^ - 4 (116) 

6 (116) *15* 



Errrs i^K) did not have a^decision mastery 



UNIT PRE It OF units 

. , DAY COMPLETED (TO DAY) 



PAN, PETER 



FAPP 105 



(H6) 



THE NUMBER ENCLOSED IN ASTERISKS FOLLWING THE 
OF UNITS COMPLETED SIGNIFIES THAT THIS STUDENT HAS SPENT 
LONGER THAN THIS EXPECTED NUMBER OF DAYS WITIIIN'THIS UNITi 
PLEASE DO A QUERY INDIVIDUAL PROFILE TO DISCOVER WHY. 



REPORT 2:C0VERING UNITS WITH STATUS CURRENT AS OF DAY 116 
FOR GRADE 5 m CLASS 1 

STUDENTS VJHO HAVE FAILED TME SAME CET MORE THAN ONCE 



STUDENT 
LAMB/ MARY 



ACTIV UNIT SKILL DAY OF »C «T "OF 
ACTIV / COMPLI 



PCET FAPP 3 100 2 5 y 4 (116) 

105 2 5 
111 3 5 

THERE ARE NO STUDENTS WHO HAVE F/\ILED THE SAME POST TEST ^^ORE THAN ONCE 




iprs 

(TO DAY) 







Figure 2 

Sample Outputs for R6port 1 and 2: A Weekly 
Summary of Students' Progress for Each Class 



7. 



/ 




TYPE THE NAME OF THE PPDGPflM YSU WFlflT TD PUN 



- / 

/ 
i 

I 



UNIT SUMMfiPY - PRDPOI?flDN DF PPETEST SKILLS t/RSTEPEtl THE FIRST.. T^t ME 
TYPE STOP TO TEFfllHflTE "REQUESTS . .ji/'^'.j | 



UNIX*^*M/40 

S-TART with DPY NU^ER-***4 0 y/ ^ 
/'END WITH DAY Nj^ER/ ♦♦♦60 /J^ 
UNIT^^^STDP 



PROPORTION OF PRETEST SKI 

M/4 



DRY NUMBER 40^ THROUGH 60 

GRADE -'3 



SKILL 
, ^MASTERED 
J «TESTED 

FERED 



SKILb 
' ' JJMASTEPED 
! «TESTED 

•-iMASTERED 




TERED 'FIRST J-IME 




St^ILL 
"MASTERED 
sjTESTED^ 
■/iMASTfiPED 



a!, 



STUDENTS 



«1 J52 


ii3 


a 4 


«5 


i?6 


«7 : 


»8 


8 1 


0 


0 


.0 1 


0 


0 . 


0 


2 2 


2 


2 


'2 


2 


2 . 


2 


100 50 


0 


b 


0 


0 


0 ; 


0 
# 


GRADE 


4 


2 STUDENTS 








»1 «2 




«4 




!:6 






1 1 


, 0 


0 • 


0 


0 


0 


0 


2 2 


2 


2 


£ 


2 


2 


2 


50 50 


0 


0 


0 


0^ 


0 


0 


ALL GRADES 


4 STUDENTS 












- !S4 


«5 




!S7 




3 S 


0 


0 


0 




0 


0 


4 4 


4 




4 ' 


4 . 


4 


4 


75 50 


0 


0 


0 


0 


0 


0 



«9 
0 

$ 
0 





!Sl 0 

0 
2 
0 



!Sl 0 

0 
4 
0 



«11 

0 
2 

.0 



' 0 
4 
0 

y 




Sample Output for ?^mAS: A Sunmajry of the Percent of 
Students Who Haltered, Each Skill on ft Pretest 



UNIT»»«M/il^ 

START WITH DAY NUMBER 

END WITH DAY r^EP *«#45 

unit«*»st6p 

REPORT ON POSTTEST PASSAGE FOR UNIT tVll 
DAY NUrCER 1 THROUGH 45 

GRADE! 



It) 


DAY OF TEST* 


RF^II T 


xu^ / 




DAecpn 




J / 




y <j± 1 




FAILED 




40 


PASSED 


9352 


44 


FAILED 


9385. 




PASSED 


9396 


36 


PASSED 


9A32 


• 23 


PASSED 


9476 


12 


FAILED- 




18 


FAILED 


9487 


42 • 


PASSED 


9578 


17 


PASSED 


9614 


' 18 1 


PASSED 


9636 


41 


PASSED 


"9647 


44 


■ PASSED 


9669 


41 


PASSED 



14 STUDENTS INVOLVED 



//TIMES, TAKEN 
IfWO PASSED 
//TESTED 
%PASSED 



1 


2 


3 


4 


5 


6 


>6 


11 


1 


0 


0 


• 0 


0 


0^ 


14 


2 


0 


0 


0 


0 


0 


78 


50 


0 


0 


0 


0 


0 



ALL GRADES 



14 STUDENTS INVOLVED 



'/TIMES TAKER 


1 


2 


3 


4 


5 


6 


•6 


//WHO PASSED 


11 


1 


0 


0 


0 


- 0 


0 


//TESTED 


lA 


2 ■ 


0 


0 


'0 


0 


0 


^PASSED 


78 


50 


0 


0 


0 


0 


0 




Figure 4 

.Sample Output for PSMAS; . A Sample of 
% Posttest' Passage for flTUiiit 



r 



9 



♦BUN - ; • 

TYPE THE NAME OF THE PROGRAM YOU /VANT TO RUN' 

♦♦♦ SKPILE . 



9 



/ ' • . 

NUMBER OF DAYS BY SKILL" - UNIT SUMMARY 

it.- 



DAY NUMBER 



ID 



NUMBER OF DAYS BY^ SKILL 



1 -THROUGH/ 35 






1 


2 


3 


\ 4 


' 5 


6 • 


7 


8 


9 


.10 


1 1 


TOTAL 


4663 


2*0 


2.0 


2.^ 


3.6 


2.4 


2.0 


• 

2.0 


0.0 


0.0 


0*0 


0.0. 


17.0 


4058 


2*7 


2.3 


3.5 


3.1 


2.»7 


2*3 


6.2 


0.0 


0.0 


0i0 


0.0 


23.0 


4162 


4.1 


2.9 


4.9 


4.9 


3.7 


3.3 


3«3 


0.0 


0.0 


0*0 


0.0 


27.0 


4253 


1 .4 


1 .4 


1 .4 


i.4 


1 .4 


1 .4 


2.4 


0*0 


0.0 


0.0 


0%0< 


u.^ 


4264 


1.7 


1.'7 


2.0 


2.3 


1.7, 


1 .7 


2.0 


0.0 


«0.0 


0»0 


0.0 


13.0 


3352 


0.4 


4-7 


0.4 


,4.^0 


3.2 


3.2 


2.2 


.0.0 


0.0 


0.0 


0.0 


18.0 


3682 


0.3 


3.0 


2.7 


5.3 


3.0 


•3*0 


4.7 


0'.0 


0'.0" 


0.0 


0.0 


22^0 


9705 


0.4 


0.4 


0.4 




0.4 


0.4 


1.5 


0.0 


0.0 


0.0 


0.0 

1* 


4*0 

i 



SKILL 


MEDIAN # OF DA/S - 


# OF DAYS 


SPENT 




SPENT IN THE UNIT 


' MINIMlfN 


MAXIMUM 


1 


^ 1.6 ' 


0.3 


4.1 


2 


2.2 \ 


0.4 




3^ 


2.3 


.0.*4 


4.9 ' 


4 


3.4 • 


'0.4 


5.3 


, 5 


2. .6/ 


0.4 


3.7 


6 


^ 2.2% 


0.4 


3.3 


7 


2.3m 


1»5 


6.2 


8 - 


0.0 


0 .0 > 


0.0 


9 


0.0 


. 0.0 .•; 


0.0 


" 10' 


0.0" / 


0.0 ' 


0 .0 


1 1 


0.0 


0.0 


0.0 


TOTAL 


17.5 

V" . 


' 4.0 


27.0 ' 









/ 



/ STOP 000000 
/El EXIT 



Figure 6 

Sample Output ,foir SKFILE; The Number of Days 
Spent inE^ch Skill for Every Student in a unit 



/ 



TEST fTcTlVITY SUMMflRY BY -CLASS 



NAME OF ACTIVITY: PAPER AND PENCIL 

«P=NUMBER DP TIMES /TEST WAS I'lflSTEReD 
* «l=NUriBER OF TIMES TESTJ^IAS TAKEN ' 



DAYS 



1- 25 
V 




S-1 

5-2 
TOTAL 



UNIT 


■ "/"^^ 


• ACTIVITY 
- CET PD"^T 


'total- 

TESTED 


EX. P. ^ * ^ 


ENPV ' 










r 

■ \ 


*%\ 


0 
1 


■ '4 . 

' ,5 


• . '0 
I 


4 
7 


0 . 

1 _ . . 


«4 T 


0 
n 


0 

X 0 


0 
0 


0. 




.«p' . - 


0' 
4 


».21 

.23^ 


4 

■ . 4 


• 25. 
31 


0 " 


. 0 
. 2 




1 


10 


• 0 

0 


«P< 
■«P 

SJI . 


0 

■ .4 

0 
2 


21 

26 

• 13 
20 


4 

5 

0 

. 3 


25 

35 

13 

- 25 


0 

• 0 • : / 

» - »■ , 

. 0 
4 


/ «p 
■ «I 


0 
13 


.68 

. 83 


9 


' ' 77 
111 


0 
5 


«p 
«I 


0 
131 


68- 
83 


9 
15 


- ^7 
111 . 


5^ 



Figure 7 V- 

Sample Output for ACS: A Test Activity Summary By Ciasa 
For Each Unit in a Specified Time Period 




iiiforaation that/should be printid the retrieval time vi^ill be short, 
r'^owever, in order to accelerate, retrieval time, this prograilji y^s designed 

to ''copy the ddta base as it eki'sts without any sorting dr -tabulation. 

■ \} . . . ^ ~- -^A 

If^^y tabulation is required, a standard program is prepared^ .t^ 

uch d at a^v Ji' sample QUERY run is given in Figure 8. • ' ^ ; b 

At the end of each academic year, the Direct filep vilX be copie^' 

'0nto DECTAPE for storage as shown in Step 10, Whenever the datia'' base f ojr 

V:-C ■ . . • . ■ \ 

a^particular year is needed, that year's complete data base can \be re- 

created in a few hours. Therefiore,, even if data is rempved from the disc., 

'it can be ..retrieved for longitudinal studies. 

^ . " ' if ■ . , ■ ^^ . . ^ • a 

Stru cture of the Data Base 

Each student activity is reduced to^>44st of attribute-value ) 
(A-y)' pairs, Tliis list is: k^pt as a record in the data base and is the > 
basic unit of retrieval. An attribute is a label assigned to each field . 
within a record. The content of any field in a record is its value. 
^The number of attributes for any given activity is fixe^ A simplified 
example of A-V piirs is givfen itiv Figure 9. ^ 

% "^le primary data sets in the system are the Direct file and the 
Inverted file. ^ The Direct file consists of records, eaqh of which has a 
special RIN (Record Identity Number) . Each record contains a description. 
(ft a^student»s activity in the form of an attribute-value list. Only the 
values are stored, because the attributes , are implicit in the format. 
The records in the Inverted . file contain a list of RINs that reference 
those records ii^ the' Direct f ile ispntaining a pkrticular attribute-value : 

pair. Each logical record In the Inverted file corresponds to a unique 
■ -.^ 
A-V pair in the Direct file. The Direct file is never searched. Instead, 

* ' ^ • - - . 



DO YOU-VWNT INSTRUCTIONS? *** YES 



A, WHEN "HEADING" APPEARS, FROM TABLE AiTYPE ATTRIBUTES 

(SEPARATED BY CCttlAS), THAT YOU WANT PRINTED. TYPE ,THENV 

.' * IN THE ORDER YOU WANT THEM PRINTED ACROSS THE PAGE. DO . 
NOT SPACE, - 

B„ WEN "TITLE" APPEARS, TYPE A REPORT TITLE OR JUST HI]: ' ^ * 
■ CARRIAGE RETURN. 



t 

* 
* 
* 



•C. WHEN "1." APPEARS^ TYPE AN ATTRIBUTE A COMMA ATJD ONE OR > * 

MORE VALUES (SEPARATED BY COMMAS). LIMIT:^ 10 VALUES, ' * 

'D. THE COMPUTER WILL CONTir«JE TO PRESET YOU WITH 2,3^, ,-^ * 

\ FOR EACH OF TICSE ENTRIES FOLLOW THE PROCEDURE IN G ABOV'E. * 

THESE ARE THE DETERMINANTS OF YOUR RETRIB/AL, WHEN YOU * 

; HAVE MADE ALL SPECIFICATIONS tYOU DESIRE TYPF. "GO" IN * 

^: RESPONSE TO ONE OF THE NUMBERS PRESEI^. * 



H^ING i miE, GF.APE, CLASS, DATE , SKILL^ §)mR, iTEST, DEC IS 

■ o , - ; 

T'iTt£: PUPILS WHO MVE FAILED COMPUTER CETlIN SKTLL 8 F I! - DIVIDE 

1, UNIT^EDIV \ / 

* ■ . . ■ • ' -' 

2, ,^LLJ .■ ^ . ■ , 

3, ACTIVjCCET ' / J "T^'^ ^ 
4/ DECIS^NMAS ■ ^ 

5, GO 



NAME GRADE^^CCASS DATE SKILL //CORP. //TEST DEC IS 

7 10 NMAS 

4 10 NMAS 

7 10 ^ms 

6 " 10 NMAS 

7 10 NMAS 
7 10 NMAS 
7 10 ' NMAS 

6 . " 10 N^iAS 

7 10 ff-^AS 
6 9 rt^AS 



.BELL, SALLY , 


5 


2 


48 


8 


BELL.SALLY 


5 


2 


50 


8 


BELL, SALLY 


.5 


2 


52 


8 


BROOKS, TOM 


4 


1 


53 


8 


COX, JIM 


5 




62 


8 


GREEN, TIM 


4 


1 


' 73 


8 


SMITH, RUTH 


4 


2 


94 


8 


SMITH, RUTH 


4 


2 


97 


8 


WOODS, JOHN 


5 


2 


99 


' 8 


WOODS, JOHN 


5 


2 


100 


8 



Figure 8 
An Exairple of QUERY Output 



INVEHTED FILE 



(1 



A-V Fair 


' RINfl> 


A 1 


1 


1 


A-Z 






i A73 


2 




1 ■ 

B-0 


1 


2 - - 


B-1 


3 




B-2 






C-1 






C-2 


3 




? C-3 


1 


2 - - 



DIRECT f FILE ' 



Record Identity 
^ .Number (RIN) 




1 
3 

I 2 



0 
0 
1 



3 



ATTRIBUTE; Possible Values 

/a (Name): 1 (John Doe), 2 (Doris Smart) , 3 (Jim Cox) 

B (Activity): 0 (paper placement test) , 1 (computer pretest) 
. 2 (computer posttest) 



C (Date): 



1 (May 5), 2 (May 6), 3 (May 7) 



Examples of Student Activities 

(1) John Doe took the paper 

placement test on May 7. - 

J p) * Jim ^ Cox took the paper 
placement test on May 7. 

(3) Dotis Smart took the 
computer pretest on 
May 6. . ^ 



List of A-V 
Pairs Describing the Activities 

(A-1) (B-0) (C-3) 



(A-3) (B-OXC-3) 
(A-2)(B-1)(C-1) 



4^ 
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Figure 9 

An Example of Using A-V Piairs^ in Data Retrieval 
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the particular records (identified by their RINs) pfertinent to a r 
ale- found using the Inverted fil^ and 'only those^records are read. , 
example, in a retr^^vaL request for Activities containing C-3 (activiti' 
occurred on May '/irTTigure 9), we first read the Inverted files to find 
RIN 1 and 2. Then, from the Direct file, we read records 1 and 2 which 
vill each contain a (C-3) pair. -This kind of filtf structure can reduce 
retrieval time substantially (Bloom, 1969). 

. , in addition to having the general advantages of the Inverted 

file, there are ^everal'ldditional features which reduce storage require- 
ments and retrieval time, 'in the Direct file, each record is formulated 
into 14 fields of specific bit lengths.. " Each field corresponds to a 
particular attribute and the bit configuration within that field supplies 
^hfe^alue of that^at tribute. By using only the number of bite's necessary 
to cover the |otal range of values for each attribute, storage require- 
'ments are si^ificantly reduced. Storage requirements are further re- i 
duced by reading and writing from the disc in Binary fornlat rather than 
ASCII (cha^cter). XJ^ng the above scheme, one record containing approxi 
I'tely 142 characters of information is stored in the equivaleat of 38 



mat 

charatter positi^^. 



in order to reduce retrieval time, the Inverted files and Direct 
files ^re distributed over 30 login numbfers (LOG 1 LOG+29) . A scheme to 
* simulate disc random access, which our software does not support, was 
developed using modulo arithmetic. The Inverte'd file is vf ragemetited 
by attribute-value pairs (each A-V pair is represented by a unique data 
Cet name). To acceg^ particular Inverted file say IXXX:MGM. where. 
XXX is a unique numerical code, the login number Is given by: 



Ogin No. = LOG + MO,D(XXX,30), . 
where MQD(XXX,30) is the remainder resulting 
from integer division of XXX by 30. 
Direct file is fragmented into sub-files of fixed length n. To 
ocate Direct file record 'number c, the login niimber is computed from: 
1 Login 1^^=L0(? + MOD (YYY, 30), , — 
where YYY.is the integer quotient resulting 
from the division/of c by n (Direct file fragment number) . 
The record number ^jlthi^-tiie ftagment DYYY;MGM for c is givnn in MOD(q,n) 
This process allows /jrfie retrieval programs to. find the shortest path 
within the fragment to the re:cord in question. 



Impj.ementation of the Information' System ^ 

The system has been implemented at the Oakleaf School, which is 
one of. the elementary igchools experimenting with Individually Prescribed 
Instruction (I?I) with the Learning Research and Development Center. 
After discussions with the potentiatl users of thie system (e.g., teachers, 
school administrators, curriculum developers, and researchers) the follow 
ing types of data were collected and- maintained in the syst^^ (1) in- 
formation concerning the st^dertt's background (e.g., student's name, ID 
number, grade, class, latest IQ and achievement test scores, last unit 
studied [or placement data]), (2) test. results that consist of data frbm 
placement tests.,, pretests. Curriculum Embi^^ded Tests (CETs) and postt^sts 
and (3) the instructional task (e.g., lesfeon booklet, textbopfc, computer 
program) prescribed by the teacher. ^ 



i7 



• Although the system' was designed for 4ata in various sub-i^ 
areas, only math data for about 200 students ffpm grade 1 through^ade 
5 were collected and stored in the data base during^e 1973-:74 academlt 
year. During the 1974-75 school year, two aa^^ i^ kindergarten werej 
also included in the data base./ TeachersV adlteT were trained to enter 
data "from the students '.prescription sheets usin^ tbe Dat^point 3300, 
and also to use the Texas Instrument model 725 tp list the'^ temporary 
files and make corrections if necessary. ^Onth^ average,, an aide initially 
required ^^oximately 30 minutes to entj^r one day of math data for a 
class of 20 s\ents. The time reqtirfed for data entry^ was ^^educed as 
^ the aides became \re familiar with the terminal. The temporary files 
created by the aides\ach d&y can be converted to the permanent data base , 
in about an hour. Teachers and supervisory personnel were given a pre- 
liminary version of the 'tnanual (Hsu, et al., 1974) in November 1973. The . 
manual described calling procedures and information, provided by th^^ users' 
prolram's. Further discussion and demons tr a tionb pf the uses of the out- 
puts vfrom these programs were conducted at mee^ir^s held "during the fol- 
, Wng two months before hand prepared recordT^ere el^jninated. 
/ , ' . in managing the instruction. Report 1 (REPOPl) , Report 2 (REI!0R2), 
- and the interactive p'rogram QUERY are used moat frequently. REPORl and 
REP0R2 are generated weekly and distributed to teachers and^ supervisory 
personnel. BPth reports are printed so that information is separated 
• according to g^de and class. The type of information contained in each 
report is illustrated in Figure 2. Notice that a special flag.- an asterisk 
is used to- call attenttpn to a student who is* spending an unusually long> 
time in a unit (as compared with the tile data for the unit from the pre- 
■ ceeding year). A teacher can then use th^ QUERY program to retrieve a 
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complete individual profile of a student in orxler .to rev^evt)isAher ^ 
particulat problem or for a parent conference/ QUE^jj^^ be us^j/. 
to ideiitify groups of students with similar ^hat'dcteristics for small- ' 
grdup instruction. GC SUM, another standard report that is regularlj^^ used , 
Iprovfiies a summary of* units completed by each student wit/hin a ^l^eci- 
ified time period. Teachers use GCSUM to prepared student^.xeport 
cards, " ] 

ihe QUERY program is also used frequently by the principal to j 

obtain data for tnanagement and^administrativ- purposes. « The principal / 
. " .^'z % ■ ./ I . . ■ ' ' 

also reviews Report 1 and Report 2 to initiate discussion with teachers. / 

When an overall distribution of students in the.math^burricula is need- 

' ■ ' * .-. ' * * ' . . 

eid, th6 principal uses status' reports 1 And 2 (see Figure 5). These 

repdrts tabulate the number of student? in each unit for both IPI (Indi-- 

vidually Prescribed InsiEruction) Math and individualized Math. 

Since the data needs op curriculum evaluators and researchers 

often focus on the effectiveness of instructional materials and tests, 

various standard reports have been prepared to meet these needs. Figures . 

- . . • 

3.:^V (>* and 7 provide typical examples. PREMAS in Figure 3 shows a, 
summarl^ df the percent of students who passed each skill oiv a pretesf. ^ 
PSMAS in Figute 4 pravifcs a Nummary of the pousttest passage in a 
spec^-fied unit. This information is useful in understanding 
the difficulty level of each skill and each unit for a grade level. 
Another indication pf the difficulty of a skill is the average number of ^ 
days students spend in a skill. SKFILE in Figure 6 illustrates the data 
that are collected for this purpose^ Standard reports were also prepared 
to tabulate data about each type of achievement test device (e.g., computer 
testing, paper ^nd pencil t^t, see Figure 7) and each type of instructional 

* 



\ . ■ /«' 

Vctivlty (e.g.i CAT lessons, lesson booklets). All, of these reports are 
lideful for curriculum and test evaluation. Nevertheless, QUERY is the 
program which continues to be used most, frequently by evaluat^rs and re- 
searchers because it is the mokt flexible in terms of the t^pes of data 
that can be obtained (see Figure 8) . 

Since this system is still in the process of development, a 
formal evaluation has not been conducted. Hoover, our experience may be 

' ■ ( 

summailized as foltcFws: (1) Preliminary reactions to the retrie^^ sys- 
tem halve been favorable. (2) The, data in the data base ar^ current to 
the proceeding school day. (3) Even though 25,000 records of data base 



are in 



the DEC-15 system, retrieval time for the QUERY program is fast.. 



(4) Retrieval time for standard reports (which are printed by the com- - 
puter Operator 'after school hours) is longlr than QUERY since these re- 
ports rjequire sorting in addition to searching. However, it usually re- 
quires about two f^nutes to print these reports for one class. (5) The 
type of information and the format of printing is flexible in the QUERY 
program. (6) Preparation of a special program used for retrieving data 
that cannot be easily obtained by the QUERY program, in most ^ cases, is 
a reasonably easy task. (6) The disc space is efficiently used by binary 
coding of the information. (7) The system is helpful in assessing an 
individual student, grouping students according to similar characteristics, 
planning instructional activities, evaluating instrvictional and testing 
materials, and collecting data for research. 

V 

Summary 

In summary^ this system has accomplished m^^t of the objectives 
stdted3previously. Specific data can be retrieve^n-line in various 
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ways with an acfieptable waiting time. Standardized reports have been ^ 
used every week to replace a weekly summary previously hand prepared by • 
aides. When the system has pass^ the initial field testing, other 
school recordkeeping pr&ctices may be aided and/or replaced by computer 
reports (e.g., eliminal:ion of hand-prepared paper prescription sheets): 
Although it is too early to determine the impact of the system onjthe 
effectiveness of managing individualized instruction, there are several 
observations that can be made. 'First, the students' daily activities 
cari' be monitored more systematically and easily by teachers and ^super- 
visory personnel. Second, inatrbctional management p-roblems can be dis- 
cdssed on the basis of actual data rather than on impressions. Third, ^ 
researchers need not be overwhelmed^ by an unmanageable amount of data. 
If a researcher asks a meaningful question.based on the data maintained, 

this inforinatibn system can provtde a^eaningful answer arranged in an 

1/ . 
organized fashion. And last, the system is designed to facilitate the 

combination of the management system with computer-assisted instruction, 

computer-a'ssffited testing, and coipputer-assisted prescription. into an 

integrated computer-based ins^^tional system. Initial results show 

that the potential for &uch an integrated system is positive. 

y 
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